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Abstract. Farkas' lemma is a fundamental result from linear programming 
providing linear certificates for infeasibility of systems of linear inequalities. 
In semidefinite programming, such linear certificates only exist for strongly in- 
feasible linear matrix inequalities. We provide nonlinear algebraic certificates 
for all infeasible linear matrix inequalities in the spirit of real algebraic geom- 
etry: A linear matrix inequality A{x) ^ is infeasible if and only if —1 lies 
in the quadratic module associated to A. We also present a new exact duality 
theory for semidefinite programming, motivated by the real radical and sums 
of squares certificates from real algebraic geometry. 



1. Introduction 
A linear matrix inequality (LMI) is a condition of the form 

n 

A{x) = Aa + Y^ x,A, ^0 {x e M") 
1=1 

where the Ai are symmetric matrices of the same size and one is interested in the 
solutions X G M" making A{x) positive semidefinite {A{x) > 0). The solution 
set to such an inequality is a closed convex scmialgcbraic subset of R" called a 
spectrahedron or an LMI domain. Optimization of linear objective functions over 
spectrahedra is called semidefinite programming (SDP) [BV96, ToOl, WSVOO], and 
is a subfield of convex optimization. In this article, we are concerned with the 
duality theory of SDP from a viewpoint of a real algebraic geometer, and with the 
important SDP feasibility problem: When is an LMI feasible; i.e., when is there an 
X satisfying A{x) >z 0? 

A diagonal LMI, where all Ai are diagonal matrices, is just a system of linear 
inequalities, and its solution set is a polyhedron. Optimization of linear objective 
functions over polyhedra is called linear programming (LP). The ellipsoid method 
developed by Shor, Yudin, Nemirovskii and Khachiyan showed at the end of the 
1970s for the first time that the LP feasibility problem (and actually the problem 
of solving LPs) can be solved in (deterministically) polynomial time (in the bit 
model of computation assuming rational coefficients) [SrSG, Chapter 13]. Another 
breakthrough came in the 1980s with the introduction of the more practical interior 
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point methods by Karmarkar and their theoretical underpinning by Nesterov and 
Nemirovskii [NN94, Ne07]. 

The motivation to replace the prefix "poly" by "spectra" is to replace "many" 
values of linear polynomials (the diagonal values of A{x)) by the "spectrum" of 
A{x) (i.e., the set of its eigenvalues). The advantage of LMIs over systems of linear 
inequalities (or of spcctrahedra over polyhedra, and SDP over LP, respectively) is a 
considerable gain of expressiveness which makes LMIs an important tool in several 
areas of applied and pure mathematics. Many problems in control theory, system 
identification and signal processing can be formulated using LMIs [BEFB94, ParOO]. 
Combinatorial optimization problems can often be modeled or approximated by 
SDPs [Go97] . LMIs also find application in real algebraic geometry for finding sums 
of squares decompositions of polynomials [LaslO, Ma08]. There is even a hierarchy 
of SDP approximations to polynomial optimization problems [Lau09] consisting 
of the so-called Lasserre moment relaxations. In this article, rather than trying 
to solve polynomial optimization problems by using SDP, we borrow ideas and 
techniques from real algebraic geometry and polynomial optimization in order to 
get new results in the theory of semidefinite programming. 

The price to pay for the increased expressivity of SDP is that they enjoy some 
less good properties. First of all, the complexity of solving general SDPs is a very 
subtle issue. For applications in combinatorial optimization, it typically follows 
from the theory of the ellipsoid method [Sr86] or interior point methods [NN94] that 
the translation into SDP yields a polynomial time algorithm (see [dK02, Section 
1.9] for exact statements). However, the complexity status of the LMI feasibility 
problem (the problem of deciding whether a given LMI with rational coefficients has 
a solution) is largely unknown. What is known is essentially only that (in the bit 
model) LMI feasibility lies either in NPflco-NP or outside of NPUco-NP. Therefore 
it cannot be NP-completc unless NP = co-NP. This follows from our work below, 
but has been already proven by Ramana [Ra97] in 1997; Porkolab and Khachiyan 
[PK97] have proved that either for fixed number variables or for fixed matrix size, 
the LMI feasibility problem lies in P. Second, the standard (Lagrange-Slater) dual 
of a semidefinite program works well when the feasible set is full-dimensional (e.g. 
if there is a: £ R" with A{x) >- 0). However, in general, strong duality can fail 
badly, and there is no easy way of reducing to the full-dimensional case. Even the 
corresponding version of Farkas' lemma fails for SDP. 

We prove in this paper a nonlinear Farkas' lemma for SDP by giving algebraic 
certificates for infeasibility of an LMI. Furthermore, we present a new exact duality 
theory for SDP. The inspiration for our sums of squares dual comes from real 
algebraic geometry, more precisely from sums of squares representations and the 
Real Nullstellensatz [Ma08, PDOl, Sc09]. We believe that this new connection will 
lead to further insights in the future. 

Reader's guide. The paper is organized as follows: We fix terminology and nota- 
tion in Section 2. Our main results, including the sum of squares dual of an SDP, 
are presented in Section 3. The two crucial ingredients needed in the proof are a 
low-dimensionality certificate for spcctrahedra (sec Subsection 3.3), and a new Pos- 
itivstellensatz for linear polynomials nonnegative on a spectrahedron (see Theorem 
3.4.1 in Subsection 3.4). Finally, in Subsection 3.7, we present the sums of squares 
dual (D*'°'') of an SDP, and Theorem 3.7.3, an algorithmic variant of the linear 
Positivstellensatz. Section 4 contains applications of these results. For example, in 
Subsection 4.2 we interpret Theorems 3.4.1 and 3.7.3 in the language of real alge- 
braic geometry, and in Subsection 4.3 we prove a nonlinear Farkas' lemma for SDP 
by giving nonlinear algebraic certificates for infeasibility of an LMI. These results 
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use quadratic modules from real algebraic geometry. As a side product we intro- 
duce a hierarchy for infeasibility of LMIs, whose first stage coincides with strong 
infeasibility. Subsection 4.4 contains certificates for boundedness of spectrahedra 
which are used to give a Putinar-Schmiidgen-like Positivstellensatz for polynomi- 
als positive on bounded spectrahedra. Finally, the article concludes with two brief 
sections containing examples illustrating our results, and an application to positive 
linear functionals. 

2. Notation and terminology 

We write N := {1,2, . . . } and M for the sets of natural and real numbers, respec- 
tively. Let i? be a unital commutative ring. For any matrix A over i?, we denote 
by A* its transpose. Then := {A G K^'''^ \ A ^ A*} denotes the set of 

all symmetric m x m matrices. Examples of these include hermitian squares, i.e., 
elements of the form A* A for some A € i?"^™. 

Recall that a matrix A € jg^x™ jg called positive semidefinite [positive definite) 
if it is symmetric and v* Av > for all vectors v £ R™ {v* Av > for all v € 
\ {0}). For real matrices A,B e R™^™, we write A^B (respectively A ^ B) 
to express that B — A is positive semidefinite (respectively positive definite). We 
denote by SM-y^"^ and S'R™,^™ the convex cone of all positive semidefinite and 
positive definite matrices of size m, respectively. 

2.1. Matrix polynomials. Let x = (xi, . . . ,x„) be an n-tuple of commuting vari- 
ables and M[x] the polynomial ring. With M.[x]k we denote the vector space of all 
polynomials of degree < k. A (real) matrix polynomial is a matrix whose entries 
are polynomials from R[x]. It is linear or quadratic if its entries are from K[x]i 
or M[x]2, respectively. A matrix polynomial is an clement of the ring R[x]™'^" for 
some m,n S N, and can be viewed either as a polynomial with matrix coefficients, 
or as a matrix whose entries are polynomials. For a comprehensive treatment of 
the theory of matrix polynomials we refer the reader to the book [GLR82] and the 
references therein. 

2.2. Linear pencils and spectrahedra. We use the term linear pencil as a syn- 
onym and abbreviation for symmetric linear matrix polynomial. A linear pencil 
A G R[x]"^" can thus be written uniquely as 

A^Ao+ xiAi + ■■■+ x„An 

with Ai e 5'R"''". If A e R[x]°^« is a linear pencil, then the condition A{x) h 
[x € R") is called a linear matrix inequality (LMI) and its solution set 

Sa {x e R" I A{x) h 0} 

is called a spectrahedron (or also an LMI set). We say that A is infeasible if Sa = 0, 
and A is feasible if Sa 0- 

Obviously, each spectrahedron is a closed convex semialgebraic subset of R". 
Optimization of linear objective functions over spectrahedra is called semidefinite 
programming (SDP) [BV96, ToOl, WSVOO]. If A € R[x]"^" is a diagonal linear pen- 
cil, then A{x) >z {x £ R") is just a (finite) system of (non-strict) linear inequalities 
and Sa is a (closed convex) polyhedron. Optimization of linear objective functions 
over polyhedra is called linear programming (LP). The advantage of LMIs over sys- 
tems of linear inequalities (or of spectrahedra over polyhedra, and SDP over LP, re- 
spectively) is a considerable gain of expressiveness which makes LMIs an important 
tool in many areas of applied and pure mathematics [BEFB94, Go97, ParOO, LaslO]. 
SDPs can be solved efficiently using interior point methods [NN94, StOO, dK02]. 
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2.3. Sums of squares. Another example of symmetric matrix polynomials that 
are of special interest to us are sums of hermitian squares in K[x]™^"'. They are 
called SOS-matrices. More explicitly, S S Rlx]™^™ is an sos-matrix if the following 
equivalent conditions hold: 

(i) S = P*P for some s e N and some P e R[x]"^'"; 

(ii) S = J2l=i Q*iQi for some r e N and e MH'"^'™; 

(iii) S = Y,Li ^i^i for some s G N and G M[x]™. 

A special case are sums of squares in the polynomial ring R[x]. They are called 
SOS-polynomials and they are nothing else but sos- matrices of size 1 . We denote the 
set of all SOS-matrices (of any size) over M[x] by 

:= {P*P \s,meN,Pe M[x]-'^™} . 

In particular, n R[x] is the set of sos-polynomials. 

Note that an sos-matrix S G R[x]™^™ is positive semidefinite on R" but not vice- 
versa, since e.g. a polynomial nonnegative on M" is not necessarily sos [Ma08, PDOl]. 

2.4. Radical ideals. Recall that for any ideal I C R[x], its radical ^/T and its real 
radical \/T arc the ideals defined by 

VT:={pe R[x] \3keE: f el} and 

\/T:={pe R[x] I 3fc G N : 3s G n M[x] : + .s G I}. 

An ideal I C M[x] is called radical if I = \/T and real radical iil — We refer 
the reader to [BCR98] for further details. 



3. Duality theory of semidefinite programming 

In this section we present a sum of squares inspired dual for SDP, see Subsection 
3.7. It is derived from two core ingredients, which are of independent interest. First, 
Proposition 3.3.1 below allows us to detect low-dimensionality of spectrahedra, 
thus leading to a codimension-reduction technique. Second, Theorem 3.4.1 gives 
a nonlinear algebraic certificate (i.e., a Positivstellensatz) for linear polynomials 
nonnegative on a spectrahcdron. 

3.1. Weakly feasible and weakly infeasible linear pencils. Recall that the 

linear pencil A(x) G R[x]'j'^" is infeasible if Sa = 0- We call A strongly infeasible 
if 

dist {{A{x) I X G R"}, Sm.'g,"') > 0, 

and weakly infeasible if it is infeasible but is not strongly infeasible. A feasible linear 
pencil A is strongly feasible if there is an a; G R" such that A{x) >~ 0, and weakly 
feasible otherwise. To A we associate the convex cone 

Ca := {c + ^u*Au^ I cG R>o, G R"} 

i 

= {c + tr(A5') I cgR>o, S'g S-R^^^"} C R[x]i. 

Note that Ca consists of linear polynomials nonnegative on Sa ■ 

The following is an extension of Farkas' lemma from LP to SDP due to Sturm 
[StOO, Lemma 2.18]. We include its simple proof based on a Hahn-Banach separation 
argument. 

Lemma 3.1.1 (Sturm). A linear pencil A is strongly infeasible if and only if —1 G 
Ca. 
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Proof. Suppose 

n 

i=l 

is strongly infeasible. Then the non-empty convex sets {A{x) \ x S R"} and ^R^q" 
can be strictly separated by an afhne hyperplane (since their Minkowski sums with a 
small ball are still disjoint and can therefore be separated [Ba02, Theorem III. 1.2]). 
This means that there is a non-zero linear functional 

I: S'R"''" ^ R 

and 7 G R, with £(S'R^^") C R>^ and i{{A{x) \ x € R"}) C R<^. Choose 
B G SM.°"'" such that 

e{A) = tr(ylB) 

for aU A G S'R"^". Since ^(S'R$1^") is bounded from below, by the self-duality of 
the convex cone of positive semidefinite matrices, ^ B }z 0- Similarly, we obtain 
£{Ai) = for z G {1, . . . ,n}. Note that 7 < since = ^(0) G R>^ so we can 
assume i{Ao) = —1 by scaling. Writing B = J2i ^iU* with Ui G R", we obtain 

-1 = l{Ao) = i{A{x)) = tY{A{x) - 

i i 

for all a; G R". Hence -I = J2i u*Au, G Ca- 

Conversely, if — 1 G Ca, i.e., — 1 = c + J^i u*Aui for some c > and Ui G R™, 
then with B := J^i UiU* G S'R"q" wc obtain a linear form 

fiS-R^^^^R, A^tT{AB) 

satisfying i{S'R'^l"') C R>o and l{{A(x) \ x G R"}) = {-1 - c} C R<_i. So A is 
strongly infeasible. ■ 

Lemma 3.1.2. Let A G R[x]"^" be an infeasible linear pencil. Then the following 
are equivalent: 

(i) A is weakly infeasible; 

(ii) Sa+eI^ =^ for all e > 0. 

Proof. Since all norms on a finite-dimensional vector space are equivalent, we can 
without loss of generality use the operator norm on R"^". 

Suppose that (i) holds and e > is given. Choose B G 5R"q° and x G R" with 
\\B - L{x)\\ < e. Then A{x) + el^ h 0, i.e., X G Sa+eI^ ■ 

Conversely, suppose that (ii) holds. To show that 

dist {{A{x) I X G R"}, S-R^^"}) = 0, 
we let e > be given and have to find B G SR^g" and a; G R" with 

\\A{x)-B\\<e. 

But this is easy: choose x G R" with A{x) + ela h 0, and set B := A{x) + ela. ■ 

The following lemma is due to Bohnenblust [Bo48] (see also [BaOl, Theorem 4.2] 
for an easier accessible reference). While Bohnenblust gave a non-trivial bound 
on the number of terms that are really needed to test condition (i) below, we will 
not need this improvement and therefore take the trivial bound a. Then the proof 
becomes easy and we include it for the convenience of the reader. 

Lemma 3.1.3 (Bohnenblust). For Ai, . . . ,An G S'R"'^" the following are equiva- 
lent: 

(i) Whenever ui, . . . ,Uq, G R" with X^iLi '^l^j'^^i — ^ /'^'^ "^^^ J ^ {!) • ■ • i*^}; then 
ui = ■ ■ ■ = Ua ~ ; 
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(ii) spaii(yli, . . . ,An) contains a positive definite matrix. 

Proof. It is trivial that (ii) implies (i). To prove that (i) implies (ii), note that 
SKo" = {T,tl^^< I "i,---,^a e R"} and Eti<Bu, - tr(BEt,M,<) for 
all ui, . . . ,Ua G M". The hypotheses thus says that, given any B G 5'R"q", we have 

tr(^iB) = • • • = tr(A„B) = =^ B = 0. (1) 

Now suppose that span(Ai, . . . ,A„) n 5R"q" = 0. By the standard separation 
theorem for two non-empty disjoint convex sets (see for example [Ba02, Theorem 
III. 1.2]), span(Ai, . . . ,An) and SR^g" can be separated by a hyperplane (the sep- 
arating afhne hyperplane must obviously contain the origin). Therefore there is a 
non-zero linear functional L: S'R"^" — R with 

L(5R"o")CK>o and L(span(Ai, . . . ,A„)) C M<o. 

Then of course L(S'R"o") C M>o and L(span(Ai, . . . ,A„)) = {0}. Now choose 
B G 5R"^" such that" 

L{A) = tT{AB) for ah A G SR"""". 

Then B ^0, B e SR"^°' and tr(AiB) = • • • = tr(A„B) = 0, contradicting (1). ■ 

Lemma 3.1.4. Let A G R[x]"^" be a linear pencil which is either weakly infeasible 
or weakly feasible. Then there are k > I and ui,...,Uk G R" \ {0} such that 
= 0. 

Proof. Assume that the conclusion is false. By Lemma 3.1.3, we find xo,Xi, . . . ,Xn G 
R such that 

XqAq + XiAi + • • • + XnAn >~ 0. 

Of course it is impossible that xq > since otherwise A{0) >- 0. Also a;o = 
is excluded (since otherwise A{cxi, . . . ,cXn) )^ for c > large enough). Hence 
without loss of generality xq = —1, i.e., xiAi + • • • + a:„A„ >- Aq. Choose £ > 
such that 

xiAi H 1- x„A„ Ao + 2ela. 

By Lemma 3.1.2, we can choose some y G Sa+sIc- But then 

Ao + {xi + 2yi)Ai + • • • + (x„ + 2y„)A„ y 2{Ao + elm + yiAi + ■■■ + y„AO > 0, 
contradicting the hypotheses. ■ 

3.2. An algebraic glimpse at standard SDP duality. We now recall briefly 
the standard duality theory of SDP. We present it from the viewpoint of a real 
algebraic geometer, i.e., we use the language of polynomials in the formulation of 
the primal-dual pair of SDPs and in the proof of strong duality. This is necessary 
for a better understanding of the sums of squares dual (D^"'*) given in Subsection 
3.7 below. 

A semidefinite program (P) and its standard dual (D) is given by a linear pencil 
A G M[x]"^" and a linear polynomial I G R[x]i as follows: 

(P) minimize i{x) (D) maximize a 

subject to xgR" subject to 5 G S'R"^", a G R 

A{x) ^0 5^0 

l-a^iY{AS) 

To see that this corresponds (up to some minor technicalities) to the formulation 
in the literature, just write the polynomial constraint £ — a = tr(AS') of the dual as 
71 + 1 linear equations by comparing coefficients. 
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The optimal values of (P) and (D) are defined to be 

P* := vai{l{x) I .T e M", A{x) ^ 0} G K U {±00} and 

D* := sup{a | S € SR'^q" , a G M, ^ - a = tr(AS')} e K U {±00}, 

respectively, where the infimum and the supremum is taken in the ordered set 
{—00} U R U {00} (where inf = 00 and sup = —00). By weak duality, we mean 
that P* > D* , or equivalently, that the objective value of (P) at any of its feasible 
points is greater or equal to the objective value of (D) at any of its feasible points. 

Fix a linear pencil A. It is easy to see that weak duality holds for all primal 
objectives £ if and only if 

feC'A =^ f>OonSA 

holds for all / G M[x]i, which is of course true. By strong duality, we mean that 
P* = D* (zero duality gap) and that (the objective of) (D) attains this common 
optimal value in case it is finite. It is a little exercise to sec that strong duality for 
all primal objectives £ is equivalent to 

f>OonSA ^ feCA 

for aU / e K[x]i. 

Unlike weak duality, strong duality fails in general (cf. Subsection 4.6 below). 
However, it is well-known that it docs hold when the feasible set Sa of the primal 
(P) has non-empty interior (e.g. if A is strongly feasible). Here is a real algebraic 
geometry fiavorcd proof of this: 

Proposition 3.2.1 (Standard SDP duality). Let A e S'M[x]"^" be a linear pencil 
such that Sa has non-empty interior. Then 

f>OonSA ^ feCA 

for all / e M[x]i. 

Proof. In a preliminary step, we show that the convex cone Ca is closed in R[x]i. 
To this end, consider the linear subspace U := {u G R™ | Au = 0} C R". The map 

a 

ip:Rx (R"/[/)" ^ Ca, {a,ui, . . . ,Ua) ^ +^u*Au, 

i=l 

is well-defined and surjective. 

Suppose (f maps {a,ui, . . . ,Ua) G (M"/?7)" to 0. Fix i e {!,...,«}. Then 
u*A{x)ui ~ for all x G Sa- Since A{x) ^ 0, this implies A{x)ui = for all 
X G Sa- Using the hypothesis that Sa has non-empty interior, we conclude that 
Aui ~ 0, i.e., Ui €z U . Since i was arbitrary and a = 0, this yields {a,ui, . . . ,Ua) = 0. 

This shows (p^^{Q) ~ {0}. Together with the fact that 1^9 is a (quadratically) 
homogeneous map, this implies that ip is proper (see for example [PSOl, Lemma 
2.7]). In particular, Ca ^ hnip is closed. 

Suppose now that / ^ R[x]i \ Ca- The task is to find x & Sa such that 
f{x) < 0. Being a closed convex cone, Ca is the intersection of all closed half- 
spaces containing it. Therefore we find a linear map ^ : M[x]i R such that 
''P{Ca) ^ R>o and V'C/) < 0- Wc can assume tp{l) > since otherwise tp{l) = 
and we can replace ip hy tp + eevy for some small e > 0, where y G Sa is chosen 
arbitrarily. Hereby ev^ : R[x]i — >■ R denotes the evaluation in x e R". Finally, after 
a suitable scaling we can even assume "0(1) = 1- 

Now setting x := {tp{xi), . . . ,V'(x„)) G R", we have = evx- So ^P{Ca) C R>o 
means exactly that A{x) >: 0, i.e., x e Sa- At the same time f{x) = ip{f) < as 
desired. ■ 
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3.3. Certificates for low dimensionality of spectrahedra. The problems with 
the standard duality theory for SDP thus arise when one deals with spectrahedra 
having empty interior. Every convex set with empty interior is contained in an affine 
hyperplane. The basic idea is now to code the search for such an affine hyperplane 
into the dual SDP and to replace equality in the constraint t — a — tr{AS) of (D) by 
congruence modulo the linear polynomial / e M[x]i defining the affine hyperplane. 
However, this raises several issues: 

First, Sa might have codimension bigger than one in M". This will be resolved 
by iterating the search up to n times. 

Second, we do not see any possibility to encode the search for the linear polyno- 
mial / directly into an SDP. What we can implement is the search for a non-zero 
quadratic sos-polynomial q together with a certificate of Sa ^ {q = 0}. Note that 
{q = 0} is a proper affine subspace of R". It would be best to find a q such that 
{q = 0} is the affine hull of Sa since then we could actually avoid the n-fold itera- 
tion just mentioned. However, as demonstrated in Example 4.6.3 below, this is in 
general not possible. 

Third, wc need to carefully implement congruence modulo linear polynomials / 
vanishing on {q = This will be dealt with by using the radical ideal from real 
algebraic geometry together with Schur complements. 

We begin with a result which ensures that a suitable quadratic sos-polynomial q 
can always be found. In fact, the following proposition says that there exists such a 
q which is actually a square. The statement is of interest in itself since it provides 
certificates for low-dimensionality of spectrahedra. We need quadratic (i.e., degree 
< 2) sos-matriccs for this. 

Proposition 3.3.1. For any linear pencil A € S'M[x]"^", the following are equiv- 
alent: 

(i) Sa has empty interior; 

(ii) There exists a non-zero linear polynomial f G IR[x]i and a quadratic sos-matrix 
S e S'RH^''" such that 

-f^ tv{AS). (2) 

Proof. From (ii) it follows that — > on Sa, which implies f = on Sa- So it 
is trivial that (n) implies (i). 

For the converse, suppose that Sa has empty interior. If there is w G R" \ {0} 
such that Au = then, by an orthogonal change of coordinates on R", we could 
assume that u is the first standard basis vector ei. But then we delete the first 
column and the first row from A. We can iterate this and therefore assume from 
now on that there is no w G R" \ {0} with Au — 0. 

Wc first treat the easy case where A is strongly infeasible. By Lemma 3.1.1, 
there are c G R>o and Ui G R" with — 1 — c = X^i'^i^"*- scaling the Ui 
we can assume c = 0. Setting S := ^iUiU* G S'M"^" and / := 1, we have 
—f" = —1 = X^i ~ tr(^S') for the constant sos-matrix S and the constant 

non-zero linear polynomial /. 

Now we assume that A is weakly infeasible or feasible. In case that A is feasible, 
it is clearly weakly feasible since otherwise Sa would have non-empty interior. Now 
Lemma 3.1.4 justifies the following case distinction: 

Case 1. There is u G R" \ {0} with u* Au = 0. 
Write A = {£ij)i<i.j<a- Again by an orthogonal change of coordinates on R", we 
can assume that u = ei, i.e., in = 0. Moreover, we may assume / := £12 7^ (since 
Aei = Au^ 0). Setting /' := i(-l - ^22), v := [/' / 0. . .0]* and 5 := vv* , we 
have 

tr(A5) = v*Av = 2/'/^i2 + /2^22 = ./'(42 + 2/') = -f\ 
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Case 2. Case 1 docs not apply but there are k > 2 and ui, . . . ,Uk G M" \ {0} 
such that J2i=i u*Aui = 0. 

Here we set / u^Aui ^ and write — / = /i — /I where /i := / + 1) G R[x]i 
and /2 := ^{^f ^ 1) ^ M[x]i. Then we can use the quadratic sos-matrix 

k 

S := fjuiul + fi^u^u* = fiuml - fjuiul = -fuiul 

i=2 

to get tr(AS') = -fu\Lui = -p. U 

The certificate (2) of low-dimensionahty exists for some but in general not for 
every afHne hyperplane containing the spectrahedron. Wc illustrate this in Ex- 
ample 4.6.3 below, where the spectrahedron has codimension two and is therefore 
contained in infinitely many affine hyperplanes only one of which allows for a cer- 
tificate of the form (2). 

3.4. Linear polynomials positive on spectrahedra. We now carry out the 
slightly technical but straightforward iteration of Proposition 3.3.1 announced in 
Subsection 3.3, and combine it with Proposition 3.2.1. We get a new type of Posi- 
tivstellensatz for linear polynomials on spectrahedra with bounded degree complex- 
ity. 

Theorem 3.4.1 (Positivstellcnsatz for linear polynomials on spectrahedra). 

Let A £ S'R[x]"^" be a linear pencil and f G M[x]i. Then 

f > on Sa 

if and only if there exist £i,...,€„ S M[x]i, quadratic sos-matrices S'i,...,5'„ G 
SR[x]^''°', a matrix S E SM.""^" andc>0 such that 

£^ + tr{AS^) e {£i,...A~i) for ie{l,...,n}, and (3) 
f-c-tY{AS)e{h,...,in)- (4) 

Proof. We first prove that f > on Sa in the presence of (3) and (4). 

The traces in (3) and (4) are obviously nonnegative on Sa- Hence it is clear 
that constraint (4) gives / > on Sa if we show that ii vanishes on Sa for all 
i € {1, . ■ . ,n}. Fix i G {1, . . . ,n} and assume by induction that £i, . . . vanish 
on Sa- Then (3) implies £f + tr{ASi) vanishes on Sa and therefore also £i. 

Conversely, suppose now that / > on Sa- Wc will obtain the data with 
properties (3) and (4) by induction on the number of variables n e Nq. 

To do the induction basis, suppose first that n = 0. Then / > on Sa just means 
that the real number / is nonnegative if A e S'M"^" is positive semidefinite. But if 
/ > 0, then it suffices to choose c := / > and S* := to obtain (4) with n = 0, and 
the condition (3) is empty since n = 0. We now assume that / < and therefore 
A ^ 0. Then we choose u € M" with u*Au = f. Setting S := uu* e SR"^"^" and 
c := 0, we have 

/ -c-tiiAS) = / - u*Au = / - / = 0, 

as required. 

For the induction step, we now suppose that n G N and that we know already 
how to find the required data for linear pencils in n — 1 variables. We distinguish 
two cases and will use the induction hypothesis only in the second one. 

Case 1. Sa contains an interior point. 
In this case, we set all £i and Si to zero so that (3) is trivially satisfied. Property 
(4) can be fulfilled by Proposition 3.2.1. 

Case 2. The interior of Sa is empty. 
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In this case, we apply Proposition 3.3.1 to obtain 7^ e IR[x]i and a quadratic 
SOS-matrix Si e 5M[x]"^" with 

ef + tr{ASi) ^ 0. (5) 

The case where £1 is constant is trivial. In fact, in this case we can choose all 
remaining data being zero since (£1, . . . /i) = {ii) ~ K[x] for all i G {1, . . . ,n}. 

From now on wc therefore assume £1 to be non-constant. But then the reader 
easily checks that there is no harm carrying out an affine linear variable trans- 
formation which allows us to assume £1 = x„. We then apply the induction hy- 
pothesis to the linear pencil A' := A(xi, . . . ,x„_i,0) and the linear polynomial 
/' /(xi, . . . ,x„„i,0) in n — 1 variables to obtain £2, ■ ■ ■ ,£n € quadratic 
SOS-matrices S2, ■ ■ ■ ,Sn e S']R[x]2^", a matrix S G ^M^q" and a constant c > 
such that 

£j +tT{A'S^) e {£2,...A~i) for i£{2,...,n} and (6) 

f -c-tY{AS)e{£2,...A)- (7) 

Noting that both / - /' and tT{ASi) - tr{A'Si) = ti{{A - A!)Si) are contained in 
the ideal (x„) = (^i), we see that (6) together with (5) implies (3). In the same 
manner, (7) yields (4). ■ 

3.5. Constructing SDPs for sum of squares problems. The (coefficient tuples 
of) SOS-polynomials in R[x] of bounded degree form a •projection of a spectrahedron. 
In other words, the condition of being (the coefficient tuple of) an sos-polynomial 
in M[x] of bounded degree can be expressed with an LMI by means of additional 
variables. This is the well-known Gram matrix method [Lau09, Ma08]. As noted by 
Kojima [Ko03] and nicely described by Hoi and Scherer [SH06], the Gram matrix 
method extends easily to sos- matrices. 

3.6. Real radical computations. Let A £ 5R[x]"^" be a linear pencil and q G 
R[x]2 a (quadratic) sos-polynomial such that —q = tr{AS) for some (quadratic) 
SOS-matrix S like in (2) above. In order to resolve the third issue mentioned in 
Subsection 3.3, we would like to get our hands on (cubic) polynomials vanishing on 
{q = 0}. That is, we want to implement the ideals appearing in (3) and (4) in an 
SDP. 

By the Real NuUstellcnsatz [BCR98, Ma08, PDOl], each polynomial vanishing 
on the real zero set {q = 0} of g lies in \/(g). This gives us a strategy of how to 
find the cubic polynomials vanishing on {q = 0}, cf. Proposition 3.6.1 and Lemma 
3.6.2 below. The Real NuUstellensatz plays only a motivating role for us; we only 
use its trivial converse: Each element of {q) vanishes on {q = 0}. 

The central question is how to model the search for elements in the real radical 
ideal using SDP. The key to this will be to represent polynomials by matrices as is 
done in the Gram matrix method mentioned in Section 3.5. For this we introduce 
some notation. 

For each d G No, let s{d) := dimIR[x]rf = {'^t") denote the number of monomials 
of degree at most d in n variables and [x]ci G R[x]'''^'') the column vector 

[x]rf := [1 xi X2 ... x„ xf X1X2 xj^]* 

consisting of these monomials ordered first with respect to the degree and then 
lexicographic. 

The following proposition shows how to find elements of degree at most d + e 
(represented by a matrix W) in the real radical I := \/{q) of the ideal generated by 
a polynomial q G M[x]2d (represented by a symmetric matrix U, i.e., q = [xj^ J7[x]c;). 
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We will later use it with d ~ 1 and e ~ 2 since q will be quadratic and we will be 
interested in cubic polynomials in X. Note that 

/ W' 



u y W*W 



W* U 



>- 



by the method of Schur complements. 

Proposition 3.6.1. Let d,e e No, let I be a real radical ideal of M.[x] and U € 
g^s{d)xs(d) g^g/j ^^^^ \x\/u\x\d e I. Suppose W e Wi'^)>'^id) ^^^1^ ^ y w*w. 

Then \x\e*W\x\d el. 

Proof. Since U — W*W is positive semidefinite, we find B e E''^''^^''^'^) with U — 
W*W = B*B. Now let pi e ]R[x] denote the i-th entry of W[x]d and qj the j-th 
entry of i?[x]rf. From 

+ • • • +p?(e) + + • • • + 9.%) = {wUdTWMd + {BUdTBUd 

= \^U{W*W + B*B)\x\a = [x]/[/[x]d e I 
it follows that pi, . . . ,Ps{e) € ^ since I is real radical. Now 

[x]e W[x]d = [x]e [pi . . ._Ps(e)]* = [Pl • ■ ■Ps{e)]Me £ I 

since I is an ideal. ■ 

The following lemma is a weak converse to Proposition 3.6.1. Its proof relies 
heavily on the fact that only linear and quadratic polynomials are involved. 

Lemma 3.6.2. Let £i,...,£t e M[x]i, and qi,...,qt € M[x]2. Suppose that U € 
g^s(i)y,s(i) satisfies 

[x]iV[x]i = 

Then there exists X>Q andW e M''(2)x«(i) satisfying XU h W*W and 

M2*wMi^£m + --- + £tqt. 

Proof. Suppose that at least one qi ^ (otherwise take W ~ 0). Choose column 
vectors a £ M-'^^) such that c*\x]2 = q^. Now let W e R-'''(2)xs(i) ^he matrix 
defined by iy[x]i = ^i^i^ that 

t t t 



i=l 



Moreover, we get 



and therefore for all x e M". 

1 



[1 



Xl 



Xn\ W*W 



Xl 



Y,i.^^{x)c^n£J{x)c,) 



< 



\ j2 mx)c,)*{£^{x)c{) + {^,{x)c,r{i,{x)c,)) 

t t 
< tJ2iUx)c^ne^{x)c,) < \Y,l,{xf, 



i=l 



i=l 
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where we set A := ^iC,; > 0. Therefore 

[1 Xi ... Xn]{XU -W*W)[l Xi ... X,^]* >Q 

for all X £ M". By homogeneity and continuity this implies y*{\U — W*W)y > 



3.7. A new exact duality theory for SDP. Given an SDP of the form (P) 
described in Subsection 3.2, the following is what we call its sums of squares dual: 
(Y)sos^ maximize a 

subject to S G SRy^", a e R 

Si,. . . ,Sn <E 5'K[x]2^" quadratic sos-matrices 
Ui,...,Un G S'R^(i)><^(i) 

Wi,...,Wn£ ]R"(2)xs(l) 

HiV,[x]i + [x]2*VK,_i[x]i + tiiAS,) = e {1, . . . ,n}) 

U,hW*W,^ (^e {!,..., n}) 
£~a+ V„[x]i - tiiAS) = 0. 

Remark 3.7.1. Just like Ramana's extended Lagrange-Slater dual [Ra97], (D^°^) 
can be written down in polynomial time (and hence has polynomial size) in the bit 
size of the primal (assuming the latter has rational coefficients) and it guarantees 
that strong duality (i.e., weak duality, zero gap and dual attainment) always holds. 
Similarly, the facial reduction [BW81, TW] gives rise to a good duality theory of 
SDP. We refer the reader to [Pat] for a unified treatment of these two constructions. 

As mentioned in Section 3.5, the quadratic sos-matrices can easily be modeled by 
SDP constraints using the Gram matrix method, and the polynomial identities can 
be written as linear equations by comparing coefficients. The Si serve to produce 
negated quadratic sos-polynomials vanishing on Sa (cf. Proposition 3.3.1) which 
are captured by the matrices Ui. From this, cubics vanishing on 5*^ are produced 
(cf. Subsection 3.6) and represented by the matrices Wi. These cubics serve to 
implement the congruence modulo the ideals from (3) and (4). Then the entire 
procedure is iterated n times. 

Just as Proposition 3.2.1 corresponds to the standard SDP duality. Theorem 
3.7.3 below translates into the strong duality for the sums of squares dual (0*^°"). 
Before we come to it, we need a folk lemma, well-known from the theory of Grobner 
bases. 

Lemma 3.7.2. Suppose d E N, f E M.[x]d and £1, . . . ,£t G ]R[x]i are linear polyno- 
mials such that / € {£1, . . . ,£t)- Then at least one of the following is true: 

(a) there exist pi, . . . ,pt € M[x]d-i such that f = pi£i -I- • • • -I- Pt£t; 

(b) there are Ai, . . . ,Af S R such that Xi£i + ■ ■ ■ + Xt£t — 1- 

Proof. Suppose that (b) is not fulfilled. Then we may assume by Gaussian elimina- 
tion and after renumbering the variables that £i = Xi—£'^ where £[ G M[xi_|_i, . . . ,x„]i. 
We now proceed by induction on t S No to prove (a). For t = 0, there is nothing to 
show. Now let t € N and suppose the lemma is already proved with t replaced by 
t — 1. Write / = J2\a\<d '^qx" with Oa G K. Setting g := /(^'j^,X2, . . . ,x„), we have 



for aU y e R"(i), i.e., AC/ h W*W. 



f-9 



'a 




£'{")x'^'- ■■■x] 



'n 



Pi{xi - £[) = pi£i, 



\a\<d 
l<ai 



where 




l<ai 
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Moreover, g £ {£2, ■ ■ ■ ,£t) and therefore g = p2^2 + • • • + Pt^t for some P2, ■ ■ ■ ,Pt & 
M.[x]d-i by the induction hypothesis. Now 

f = {f -g) + g = Pi£i + ---+Ptet- ■ 

Theorem 3.7.3 (Sums of squares SDP duahty). Let A G ^Rfx]"^" be a linear 
pencil and f G M[x]i. Then 

f > on Sa 

if and only if there exist quadratic sos-matrices S'i,...,S'„ G S'R[x]2'^", matrices 
Ui,... ,Un G SW'^^'^''<^\ Wi,...,Wne M'^(2)x-^(i), S G SWg,"' and c G R>o such 
that 

[x]iV,[x]i + [x|2V,_i[x]i+tr(^S,) = (i G (8) 

U,yW*W, (^G (9) 

/-c+[x]2V„[x]i-tr(A5) =0, (10) 
where Wq := 0. 

Proof. We first prove that existence of the above data imphes / > on All 
we will use about the traces appearing in (8) and (10) is that they are polynomials 
nonnegative on Sa- Let I denote the real radical ideal of all polynomials vanishing 
on iS*^. It is clear that (10) gives /> on 5a if we show that [x]2VKr, [x]i G I. In 
fact, we prove by induction that [x]2 Wi[x]i G I for aU i G {0, . . . ,71}. 

The case i = is trivial since Wq = by definition. Let i G {1, • . • ^n} be given 
and suppose that [x]2 VFi_i[x]i G I. Then (8) shows [x]i J7i[x]i < on 5^. On the 
other hand, (9) implies in particular Ui >Q and therefore [x]i J7i[^]i > on S'yi. 
Combining both, [x]i C/i[^]i ^ ^- Now Proposition 3.6.1 implies [x]2 W^iHi € by 
(9). This ends the induction and shows / > on S'a as claimed. 

Conversely, suppose now that A is infeasible. By Theorem 3.4.1 and Lemma 
3.7.2. we can choose ^1, . . . G M[x]i. quadratic sos-matrices . . . ,5^ G S'M[x]"'^", 
S G S'M^o" and q.^ G K[x]2 {I < j < i < n) such that 

i-l 

£? + ••• +4' +tr(A5i) =;^g(,„i),^, (zG{l,...,n}) and (11) 

n 

f -c-ir{AS)=Y,qn,£,. (12) 

There are two little arguments involved in this; First, (3) can trivially be rewritten 

as H h^f +tr(AS'-) G (£1, . . . ,£i_i) for i G {1, . . . Second, in Lemma 3.7.2 

applied to £1, . . . (i G {1, ... ,71 + 1}) we might fall into case (b). But then we 
may set £i+i = ••• = £„=; and S[^i = • • • = = 5 = 0. 

Now define U[ G S'R"^!)^^^!) by [x]iV;[x]i ^ i\ + ■ ■ ■ + £} ioT i £ {I, . . . ,n}. 
Using Lemma 3.6.2, we can then choose A > and W[, . . . ,W'^ G R''(2)xs(i) ^-^^ 
that 

> W[*W[ (13) 

and [x]2 W^/[x]i = — fo'^ * ^ {l,...,n}. Setting W„ := Wj^, equation 

(12) becomes (10). Moreover, (11) can be rewritten as 

[x]i*C/;[x]i + [x|2*W/_i[x|i+tr(A50 = (7 G {1, . . . ,n}) (14) 

To cope with the problem that A might be larger than 1 in (13), we look for 
Ai, . . . ,A„ G R>o such that Ui > W*Wi for all i G {1, . . . ,n} if wc define Ui := Ajf7| 
and Wi-i XiWl_^ for all i G {l,...,n} (in particular Wq = 0). With 
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this choice, the desired hnear matrix inequahty (9) is now equivalent to XiU^ y 
\i+iWl*Wl for i e {1, ... ,71 - 1} and A„[/; h W','^ . Looking at (13), we therefore 
see that any choice of the Ai satisfying \i > AAf_|_^ for z e {1, ... ,n — 1} and A„ > A 
ensures (9). Such a choice is clearly possible. Finally, equation (14) multiplied by 
Xi yields (8) by setting Si := XiS'^ for i g {1, . . . ,n}. ■ 

4. POSITIVITY OF POLYNOMIALS ON SPECTRAHEDRA 

In this section we present applications of the results presented in Section 3. We 
interpret Theorems 3.4.1 and 3.7.3 in the language of real algebraic geometry in 
Subsection 4.2, and prove a nonlinear Farkas' lemma for SDP, i.e., nonlinear alge- 
braic certificates for infeasibility of an LMI, in Subsection 4.3. These results use 
quadratic modules from real algebraic geometry, which we recall in Subsection 4.1. 
As a side product we obtain a hierarchy for infeasibility of LMIs, whose first stage 
coincides with strong infeasibility. Subsection 4.4 contains certificates for bound- 
edness of spectrahcdra and a Putinar-Schmiidgen-like Positivstellensatz for poly- 
nomials positive on bounded spectrahcdra. Finally, the section concludes with two 
brief subsections containing examples illustrating our results, and an application to 
positive linear functionals. 

4.1. Quadratic module associated to a linear pencil. Let i? be a (commuta- 
tive unital) ring. A subset M C i? is called a quadratic module in R if it contains 
1 and is closed under addition and multiplication with squares, i.e., 

1 e M, M + M C M, and a'^M C M for all a £ R, 

see for example [Ma08]. A quadratic module M C i? is called proper if — 1 ^ M. 
Note that an improper quadratic module AI in a ring R with £ R equals R by 
the identity 

4a = (a + if - (a - if for all a £ R. (15) 

An LMI A{x) >: can be seen as the infinite family of simultaneous linear in- 
equalities u*A{x)u > {u £ R™). In optimization, when dealing with families of 
linear inequalities, one often considers the convex cone generated by them (cf. Ca in 
Subsection 3.1). Real algebraic geometry handles arbitrary polynomial inequalities 
and uses the multiplicative structure of the polynomial ring. Thence one considers 
more special types of convex cones, like quadratic modules. One of the aims of 
this section is to show that it is advantageous to consider quadratic modules for 
the study of LMIs. Since quadratic modules are infinite-dimensional convex cones, 
we will later on also consider certain finite-dimensional truncations of them, see 
Subsection 4.3. 

Definition 4.1.1. Let A be a linear pencil of size a in the variables x. We introduce 
Ma ■■= {s + J2v*M I se ^M[x]^ eR[x]"} 

i 

= + tT{AS) I s £ M[x] SOS-polynomial, S £ R[x]"''" sos-matrixj C R[x], 

and call it the quadratic module associated to the linear pencil A. 

Note that for any linear pencil A, each element of Ma is a polynomial nonneg- 
ative on the spectrahedron Sa- In general. Ma does not contain all polynomials 
nonnegative on Sa (e.g. when A is diagonal and dimS'^ > 3 [Sc09]; another sim- 
ple example is presented in Example 4.2.5 below). For diagonal A, the quadratic 
module Ma (and actually the convex cone Ca) contains however all linear poly- 
nomials nonnegative on the polyhedron Sa by Farkas' lemma. For non-diagonal 
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linear pencils A even this can fail, see Example 4.2.5 below. To certify nonnegativ- 
ity of a linear polynomial on a spectrahedron, we therefore employ more involved 
algebraic certificates (motivated by the real radical), cf. Theorem 3.4.1 and its 
SDP-implementable version Theorem 3.7.3. These two theorems yield algebraic 
certificates for linear polynomials nonnegative on Sa- While they have the advan- 
tage of being very well-behaved with respect to complexity issues, their statements 
are somewhat technical. Leaving complexity issues aside, one can use them to de- 
duce a cleaner algebraic characterization of linear polynomials nonnegative on 5*^ • 
Indeed, given / S M[x]i with / > on 5*^1, the certificates in Theorems 3.4.1 and 
3.7.3 can be seen to be equivalent to / € Ca + Vsupp Ma by means of Prestel's 
theory of semiorderings. Note that each element of Ca + \J supp Ma is obviously 
nonnegative Sa since the elements of \J supp Ma vanish on 5'^- 

Finally, this will allow us to come back to the quadratic module Ma- We will 
show that it contains each linear polynomial nonnegative on Sa after adding an 
arbitrarily small positive constant^ see Corollary 4.2.4. 

In this subsection, basic familiarity with real algebraic geometry as presented 
e.g. in [BCR98; Ma08, PDOl] is needed. The following proposition follows easily 
from Prestel's theory of semiorderings on a commutative ring, see for example [Sc09, 
1.4.6.1]. 

Proposition 4.1.2. Let M be a quadratic module in IR[x]. Then 

\/ supp il/ = \J supp i\/ = [^{supp S I S semiordering of M[x], M C S}. 

We explicitly extract the following consequence since this is exactly what is 
needed in the sequel. 

Lemma 4.1.3. Let M be a quadratic module in R[x]. Then 

(i/suppM - M) n M C ^supp M. (16) 

Proof. To prove (16), suppose p € M can be written p = g — q with g G ^/suppM 
and q G M. By Proposition 4.1.2, we have to show that p g supp 5 for each 
semiordering S of R[x] with M C S. But if such S is given, then g G suppS* and 
therefore p = g — qE—S&s well a.s p E M C S. Hence p E supp S. ■ 

4.2. Linear polynomials positive on spectrahedra revisited. With Lemma 
4.1.3 at hand, we can now give a conceptual interpretation of the certificates ap- 
pearing in Theorem 3.4.1, disregarding the complexity of the certificate. 

Proposition 4.2.1. If A e S'K[x]"^" is a linear pencil, /,£i,...,i!„ e IR[x]i are 
linear polynomials, Si, . . . ,Sn G S'R[x]2 ^" are quadratic sos-matrices, S G S'R"q" 
and c G ]R>o are such that (3) and (4) hold, then f G Ca + v^suppMj. 

Proof. Set I ^/supp Ma . It is clear that (4) gives / G Ca -f- 1 if we prove that 
£i G I for all i G {l,...,n}. Fix i G {!,..., n} and assume by induction that 
£i,... ,ti-i G I. Then (3) implies €f + triASi) G I and therefore if e {I - Ma) n 
R[x]2 C (I - Ma) n Ma C I by (16). ■ 

We get the same interpretation for the certificates from Theorem 3.7.3. 

Proposition 4.2.2. If A G S'M[x]"^" is a linear pencil, f G M[x]i is a linear polyno- 
mial, Si,...,Sn e S'M[x]^''" are quadratic sos-matrices, C/i,...,C/„ G S'lR'^i'^"*^), 
Wi,...,Wn € S G S-R^o" and c G E>o are such that (8), (9) and (9) 

hold, then f G Ca + VsuppAJX. 
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Proof. Set I := ^/suppTTA■ It is clear that constraint (10) gives / <E Ca + 1 if we 
show that [x]2Wn[x]i E I. In fact, we show by induction that [x]2VKi[x]i e I for all 
i € {0,...,n}. 

The case i = is trivial since Wq = by definition. Let i £ {!,..., n} be 
given and suppose that we know already [x]2 Wi_i[x]i <S I. Then (8) shows 
[x]i [/i[x]i el — Ma- On the other hand (9) implies in particular Ui ^ and 
therefore H/c/^Hi e E^^H^ ^ Ma- But then \x\i*U,\x\i e {I - Ma) CiMa'^I 
by (16). Now (9) yields [x]2 W^i[^]i G 2^ by Proposition 3.6.1 since I is real radical 
by Proposition 4.1.2. This ends the induction. ■ 

The following corollary is now a generalization of Proposition 3.2.1 working also 
for low-dimensional Sa (note that suppM^i = (0) if Sa has non-empty interior). 

Corollary 4.2.3. Let A e S'M[x]"''" be a linear pencil. Then 



f >0 on Sa ■^=^ f e Ca + v^supp Ma 

for all f e R[x]i. 

Proof. Combine either Theorem 3.4.1 with Proposition 4.2.1, or Theorem 3.7.3 with 
Proposition 4.2.2. ■ 

Corollary 4.2.4. Let A e S'M[x]°''" be a linear pencil. Then 

f>OonSA <^ Ve > : / + e e Ma 

for all f e M[x]i. 

Proof. To prove the non-trivial implication, let / e M[x]i with / > on Sa be given. 
It suffices to show f + e £ Ma for the special case e = 1 (otherwise replace / by ef 
and divide by e). By Corollary 4.2.3, there exists g e Ca, P € M[x] and fc G N such 
that / = g+p and p'' e J := suppAf^- Now f+e = f+1 = 5+(/-g) + l = g+{p+l) 
and it is enough to show that p + I E Ma. This will follow from the fact that the 
image of p 4- 1 is a square in the quotient ring R[x]/I. Indeed, since the image of p 
in R[x]/I is nilpotent (in fact the image oi p'' is zero), we can simply write down 
a square root of this element using the finite Taylor expansion at 1 of the square 
root function in 1 given by the binomial scries: 



p+l= [Yl (^■)p'] modX. 



We point out that adding an e > in Corollary 4.2.4 cannot be avoided: 
Example 4.2.5. Consider 

X 

Then 5'^ = {0}. Hence obviously x > on S'a. But it is easy to see that x ^ Ma 
[Za, Example 2]. 

4.3. Infeasibility of linear pencils. Let A be a linear pencil. In Subsection 
3.1 we have introduced the convex cone Ca ^ R[x]i and above we have defined 
the quadratic module Ma ^ K[x] associated to A, both consisting of polynomials 
which are obviously nonnegative on the spectrahedron Sa- The convex cone Ca 
is in general too small to detect infeasibility of A (=the failure of strong duality 
for the standard primal-dual pair of an SDP; see also Subsection 4.6 below). On 
the other hand, as an easy consequence of Corollary 4.2.4, we have the following 
version of Parkas' lemma for SDP which unlike Lemma 3.1.1 does not only work for 
strongly but also for weakly infeasible linear pencils. The price we pay is that we 
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have to replace the finite-dimensional convex cone Ca by the infinite-dimensional 
quadratic module Ma- 

Corollary 4.3.1 (Nonlinear Farkas' lemma for semidefinite programming). Let A 

be a linear pencil. Then 

Sa = -1 e Ma- 

In other words, A is infeasible if and only if Ma is improper. 

To pass from the infinite-dimensional Ma to finite-dimensions, we introduce 
truncations of Ma- 

Definition 4.3.2. Given a linear pencil A of size a and k G Nq, let 

i j 

= |s + tr(AS') I s e M[x]2fe SOS-polynomial, S G M[x]2^^" sos-matrixj 

CR[x]2fc+l, 

be the truncated quadratic module with degree restriction k associated to A- Note 
that m\°^ = Ca- 

Our main result in this subsection is the following quantitative strengthening of 
Corollary 4.3.1: 

Theorem 4.3.3. Let A be an infeasible linear pencil of size a in n variables- Then 

-iGMr"^"-""^-^). 

We present a self-contained proof of Theorem 4.3.3 based on the following two 
lemmas. 

Lemma 4.3.4. Let A be an infeasible linear pencil in n variables. Then 

-leMf-'\ 

Proof. We shall prove this by induction on n. The statement is clear for n = 0. 
Given n € N and 

n 

A = Ao + J2^^A,eSR[x]'l'''', 
1=1 

we assume the statement has been established for all infeasible linear pencils with 
n — 1 variables. 

By Lemma 3.1.4, there is an u G K"~ \ {0} with u*(/q ® A)u — 0. Replacing A 
by /q, (8) ^ changes neither M^j'^-' nor Sa = 0- Without loss of generality, we assume 
therefore that there is w G \ {0} with u*Au = 0. Writing A = {iij)i<ij<a and 
performing a linear coordinate change on R", we can moreover assume in = 0. 
Furthermore, without loss of generality, £12 7^ 0. Setting £' := — 1 — £22), v := 
[£' ^12 ... 0] * and S := vv* , we have 

tT{AS) = V*Av = 2tel2 + ^?2^22 = ^{(22 + 2£') = -^?2 ^ ^4'^- (1^) 

If £i2 G R, we are done. Otherwise after possibly performing an affine linear change 
of variables on R", we may assume £12 = x„. 

Now A' := A{xi, . . . ,x„_i,0) is an infeasible linear pencil in n — 1 variables. By 

our induction hypothesis, —1 G A/^, . In particular, there are 



Pi G R[x]2r.-i_i and vj G R[x]2r.-i_i 
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satisfying 

Let q := J^j Vj^nVj & M[x]2'.-2. Then 

i 3 

^ 2^pf + 2Y^ v*Avj - 2qxn + 1 

i 3 

= 2 + 2 ^ v*Av, + (1 - gx„)2 + q^-^l). 



(18) 



Since degg < 2" - 2, we have ^^(-x,,,) S A/jf" ^' by (17). Taken together with 
(1 - gx„)2 e M^^""^\ (18) implies -1 e Mjf""^^ ■ 

Lemma 4.3.5. Let A be an infeasible linear pencil of size a. Then 

Proof. We prove this by induction on a. The statement is clear for a = 1. Given 

n 

A = Ao + J2^^^^ e 5R[x]?'^" 
1=1 

of size m > 2, we assume the statement has been estabhshed for aU infeasible linear 
pencils of size a — 1. If L is strongly infeasible, then — 1 G Ca = M^'' by Lemma 
3.1.1. So we may assume A is weakly infeasible. 

Claim. There is an affine linear change of variables after which A assumes the 
form 

\bo b* 
b A' 



L 



where bo G M[x]i, b = [bi 
and bj G IR[x]i satisfy 



ba-i] e M[x]" ^ , j4' is a linear pencil of size a — 1 , 

(19) 



6^ e M^2^ for j = 0, . . . ,a - 1 



Furthermore, bo can be chosen to be either or xi. 

Explanation. By Lemma 3.1.4, there is A; € N and ui, . . . ,Ufe G \ {0} with 
J2'i=i u*Aui = 0. We distinguish two cases. 

Case 1. There is u e R" \ {0} with u*Au = 0. 
Write L = {(ij)i<i,j<a- By changing coordinates on R", we can assume that u is 
the first standard basis vector, i.e., in = 0. Hence 

L 



b* 
b A' 



where6=[5i ••• 6„-i] * e KH^*"^ and ^' is a linear pencil of size a — 1 . As in 
the proof of Lemma 4.3.4, we deduce that -b'j € M^^^ for all j 1, . . . ,a - 1. 

Case 2. Case 1 does not apply but there are k > 2 and ui, . . . ,Uk G \ {0} 
such that X]i=i u*Aui — 0. 
In this case, 



hi ■■= ulAui = - ^ u*Aui e n -Ca = m'^^ n -M^ 



A SUM OF SQUARES DUAL FOR SDP AND INFEASIBLE LMI 



19 



Since Case 1 does not apply, £11 ^ 0. Furthermore, since A is assumed to be weakly 
infeasible, ^ M. Hence after an afRne linear change of variables on M", we can 
assume i\\ = xi. Thus 

Xl b* 
b A' 



A = 



where 6 = [61 • • • ba~i\ * € ^ and A' is a linear pencil of size a — 1. Note 

that 

-4x2 ^ _ ^^)2^^ ^ ^ Xi)2(-Xi) 

shows that — xf € Using this, one gets similarly as above that also each of 

the entries bj of b satisfies —5^ e M^K This proves our claim. □ 

If one of the bj e K.\ {0}, we are done by (19). Otherwise we consider two cases. 

Case a. The linear system bo{x) = 0, b{x) = is infeasible. 
Then wc proceed as follows. There are 70, . . . ,7ct-i € R satisfying 

i=o 

For each j = 0, . . . ,a — 1 and (5 G R we have 

5. \2 5^ 



(20) 



l + 5b, = {l + -b,) +-{-b])eM^ 
by (19). Hence (20) implies 

a — 1 a — 1 



(1) 

A 



-1 = 1-2 



i=0 



J=0 



(1) 



Case b. The linear system bo{x) = b{x) = is feasible. 
Then we perform an affine linear change of variables on M" to ensure 

{x e M" I bo{x) = 0, b{x) = 0} = {0}'^ X M"-'' 

for some r G N. Moreover, we may assume xi, . . . ,Xr are among the entries bj, 
j = 0, . . . ,a - 1. 

Now A" :— A'{Q, . . . ,0,Xr+i, . . . , x„) is an infeasible linear pencil of size a— 1. By 



our induction hypothesis, —1 G ^I-a" particular, there are s £ n M[x] 

with degs < 2°"-^ - 2, and G R[x]2c7-2_i satisfying 

-1 = s + Yv*A"v^. 

i 

Introducing 

qt := '^vlAtVi e M[x]2c-i_2 



-1) 



and 



e Kx 



we have 

-1 = {2s + 2^v*A"v^) +1 



r 1 

(2.S + 2 E vl^v, - E 2gtxt) + E ((^ - %/^9tXt)' + 2gtxt + rg2(_x2) 

i t=l t=l 

2s + 2 E + E " V^gtxt)' + E )• 

i t=i t=i 



(21) 
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Combining qU-^t) e ' with - y/^qt^t)^ G m'^" ' ^\ (21) implies 

-ieMf~'K ' . 

Proof of Theorem 4.3.3. Immediate from Lemma 4.3.4 and Lemma 4.3.5. ■ 

Remark 4.3.6. With the aid of truncated quadratic modules associated to a linear 
pencil A, we can introduce a hierarchy of infeasibility: A is called k-infeasible for 
fc e No, if -1 G M^^'' and -1 ^ A/jf~^'. By Lemma 3.1.1, ^ is strongly infeasible 
if and only if it is 0-infeasible, and A is weakly infeasible if and only if it is k- 
infeasible for some fc G N. Detecting fc-infeasibility can be implemented as an SDP, 
cf. Subsection 3.5. 

4.4. Bounded spectrahedra. In this section we establish algebraic certificates for 
boundedncss of a spectrahcdron. As a corollary, we obtain a Putinar-Schmiigen- 
type Positivstellensatz for polynomials positive on bounded spectrahedra, see Corol- 
lary 4.4.4. 

A quadratic module M C K[x] is said to be archimedean if one of the following 
equivalent conditions holds: 

(i) V/ G M[x] 3N eN: N + f e M; 

(ii) 3N eN:N± J2ti X? G M; 

(iii) \fie{l,...,n}3N eN:N± ^"^^ Xf e M; 
see [Ma08, Corollary 5.2.4]. 

Obviously, if Ma is archimedean for a linear pencil A, then Sa is bounded. In 
[HKM] complete positivity (see e.g. [EROO, BL04, Pau02, Pis03]) was used to deduce 
that for strictly feasible linear pencils the converse holds. Subsequently, a certain 
generalization of this result for projections of spectrahedra has been proved by 
other techniques in [GNll]. In this section we will establish the result for arbitrary 
bounded Sa- We deal separately with the relatively easy case of non-empty Sa 
(possibly with empty interior). 

Lemma 4.4.1. Let A be a linear pencil with Sa ^ 0- Then 

Sa is bounded <f=^ Ma is archimedean. 

Proof. The direction (<^) is obvious as remarked above. Let us consider the con- 
verse. We first establish the existence of finitely many linear polynomials in Ca 
certifying the boundedness of Sa- 

There is a ball B C R" with Sa ^ B and SaCiOB 0. For every x e dB there 
is a vector u G with 

uA{x)u < 0. (22) 
By continuity, (22) holds for all a; in a neighborhood Ux of x. From {Ux \ x G dB} 
we extract by compactness a finite subcovering {Uxi, . ■ . , Ux^} of dB. Let £i := 

u*Aui G M[x]i and 

S -.^{xe R" I £i{x) > 0, . . . ,ir{x) > 0}. 

Clearly, Sa S and S n dB ~ 0. Since Sa is non-empty by hypothesis and 
contained in B, it follows that 5* contains a point of B. But then it follows from the 
convexity of S together with SO dB = that S C B. In particular, S is bounded. 

Now every £i G Ca C Ma. Hence the quadratic module M generated by the ii 
is contained in Ma. Choose iV G N with ± > on 5' for all i. Fix an i and 
6 G { — 1,1}. The system of linear inequalities 

-A^ + Sx, > 0,£i{x) > 0, . . . Mx) > 

is infeasible. Hence by Farkas' lemma [Fa02], there are aj G R>o satisfying 

- 1 = aoi-N + SX,) + aiti + ■■- + aJr- (23) 
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Note q;o 7^ since S ^ 0. Rearranging terms in (23) yields N — 5Xi £ Ca- Since i 
and 5 were arbitrary and Ca ^ Ma, we conclude that Ma is archimedean. ■ 

Corollary 4.4.2. Let A he a linear pencil. Then 

Sa is bounded Ma is archimedean. 

Proof. If Sa 0, then this is Lemma 4.4.1. If Sa = 0, then -1 G Ma by Corohary 
4.3.1, so Ma is archimedean. ■ 

Remark 4.4.3. Note that the above corollary is a strong variant of Schmiidgen's 
characterization [Sm91] of bounded basic closed semialgebraic sets as being exactly 
those whose describing finitely generated preorderings arc archimedean. Preorder- 
ings have the tendency of being much larger than quadratic modules. In general, a 
finitely generated quadratic module might describe a bounded or even an empty set 
without being archimedean, see [PDOl, Example 6.3.1] and [Ma08, Example 7.3.2]. 
Corollary 4.4.2 says that quadratic modules associated to linear pencils behave very 
well in this respect. 

We conclude this section with a version of Putinar's Positivstellensatz [Pu93] for 
bounded spectrahcdra: 

Corollary 4.4.4. Let A be a linear pencil and assume that Sa is bounded. If 
f e M[x] satisfies /Js^ > 0, then / e Ma. 

Proof. By Corollary 4.4.2, Ma is archimedean. Now apply (a slight generalization 
of) Putinar's Positivstellensatz [Ma08, Theorem 5.6.1]. ■ 

Remark 4.4.5. Let ^ be a linear pencil with bounded Sa- 

(1) In the case A is strongly feasible, Corollary 4.4.4 has already been proved in 
[HKM, §7] by completely different techniques, namely complete positivity from 
operator algebras. Note however that the more involved case in our approach 
occurs when A is infeasible. 

(2) From Corollary 4.4.2 it is easy to see that the quadratic module in the sense 
of rings with involution (see [KSIO]) associated to a linear pencil A of size a 
in the ring of /? x /? matrix polynomials is archimedean (in the sense of [KSIO, 
Subsection 3.1] or [HKM, Sections 6, 7]) if the spectrahedron Sa defined by A 
is bounded (cf. [HKM, Section 7]). Among other consequences, this implies a 
suitable generalization of Corollary 4.4.4 for matrix polynomials positive definite 
on the bounded spectrahedron Sa (cf. [SH06, Corollary 1], [KSIO, Theorem 3.7] 
and [HKM, Theorem 7.1]). 

4.5. An application to positive linear functionals. In this brief subsection we 
explain how our results pertain to positive linear functionals. 

Definition 4.5.1. Suppose TZ C 5*18"^" is a vector subspace, and let 72.^o '■= 
n n S'M"o"- A linear functional / : 7^ ^ K is called positive if fiUyo) C M>o. 

Detecting positivity of a linear functional can be implemented with an SDP 
using our Theorem 3.7.3. Let {Ai, . . . ,A„} be a basis for TZ, and introduce the 
linear pencil 

A = Aixi + ■■■+ A„x„ e 5M[x]?^". 

To / we associate the linear polynomial 

fA = /(Ai)xi + • • • + fiAn)xn e ]R[x]i. 

Then / is positive if and only if /aJs^ ^ 0, and this is a situation completely 
characterized by our Theorem 3.4.1. In turn, it can be implemented using (D^°^). 
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Remark 4.5.2. In subsequent work [HKMS] we shall exploit how the ideas pre- 
sented here apply to operator algebras and complete positivity [EROO, BL04, Pau02, 
Pis03], by using the resuhs from [HKM, HKM']. 

4.6. Examples. Wc conclude this paper with a scries of examples pertaining to 
the theory developed. 

Example 4.6.1. The standard textbook example [StOO, WSVOO] of a weakly in- 
feasible linear pencil seems to be 



Then -1 ^ Ca, but -1 G M 



(1) 



A := 



X 1 
1 



Indeed, for u := 
^2 = u'Au. 



[l — 1 — |]* , we have 



Hence A is 1-infeasible. 
Example 4.6.2. Let 



A 



Xl 





Then A is weakly infeasible and — 1 ^ Af^ 
Assume otherwise, and let 



Xl 
X2 

1 

(1) 




1 

Xl 



- 1 = s 



Y.v*Av„ 



(24) 



where Vj €! 
Write 



.[x]f and s e n M[x]2. We shall carefully analyze the terms v*Avj. 



and 



CyX2 



with aij,bij,Cij €E M. Then the coefficient of v*Avj equals Cj^, so C2j 



j. Next, by considering the xix| terms, we deduce c^j 
possibly contributing to x^ come from s, so s S R[xi]2. The coefficient of X2 in 



2 o„ . _ for all 
0. Now the only terms 



v*Avi 



0. 



^j-^uj IS a square, so 02 j 
anymore, leading to a contradiction with (24) 
From Theorem 4.3.3 it follows that -1 € M'f\ 



But now v*Avj docs not have a constant term 



In fact, 



A e A/jf^ since 



u* Au 



for u = 



-1 1 



Example 4.6.3. Let 



A = 



e Rfxli Thus A is 2-infeasible. 



Xl 

Xl X2 X3 

X3 Xl 



Then Sa = {(0,.T2,0) G M"^ | 0:2 > 0} and the (affine) hyperplanes containing Sa 
are {xi = 0} and {axi -I- X3 = 0} (a G K). As is shown in Case 1 of the proof of 
Proposition 3.3.1, the certificate of low-dimensionality (2) exists for the hyperplane 
{xi = 0}, i.e., there is a quadratic sos- matrix S such that — xf = tr(AS'). However, 
none of the other hyperplanes containing Sa allow for a certificate of the form (2). 

Indeed, assume that there is a € K such that {axi+xs = 0} has a corresponding 
certificate. Combining it with the one for {xi = 0}, we get a quadratic sos-matrix 
S such that 

-{2a^)xl - 2(axi + xa)^ = tr(AS') 
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which impHes 

-xl = (2axi + X3)2 + {-{2a^)xl - 2(axi + xsf ) e M^^^ . 

Specializing X3 to 1, one gets the contradiction — 1 e 1^1 a/'' where A' is the hnear 
pencil from Example 4.6.2. 
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